I'm trying to make Aim work on Windows, and I've managed to build aimrocks.

All the tests pass, except test_unicode_path. I tried fixing it, but somewhere between Python -> C Extension -> rocksdb the Unicode path name gets mangled despite Python supporting Unicode paths on Windows.

The big idea is using vcpkg to build rocksdb and all it's dependencies (zlib, ...) on Windows.

Build Instructions

Install a Windows C++ compiler

I used Visual Studio 2022 Community Edition (free). I'm not sure where the other Python packages with Windows binaries get the compiler and how they integrate it in the CI/CD.

Clone vcpkg

git clone https://github.com/Microsoft/vcpkg.git

Checkout supported version of rocksdb

The current version (HEAD) of vcpkg has rocksdb-7.7.3 which is incompatible with aimrocks. vcpkg was updated to use this version on 30 Dec 2021, so we need to use a vcpkg snapshot before that, which has rocksdb-6.27.3

cd vcpkg
git checkout tags/2022.11.14

Bootstrap vcpkg

-disableMetrics disables telemetry.

cd vcpkg
bootstrap-vcpkg.bat -disableMetrics

Build rocksdb and dependencies

We build the static library version of everything (x64-windows-static-md) so that we don't have .DLLs to manage. The -md at the end uses the DLL version of the Microsoft C Runtime (just like Python).

cd vcpkg
vcpkg install rocksdb[bzip2,lz4,snappy,zlib,zstd]:x64-windows-static-md

Clone aimrocks

Clone next to the vcpkg directories, so they are siblings:

/workdir
  /aimrocks
  /vcpkg

git clone https://github.com/aimhubio/aimrocks.git

Create virtual env

cd aimrocks
py -3.10 -m venv venv
venv\Scripts\activate.bat

Install required Python packages

python -m pip install -U pip setuptools wheel

pip install Cython==3.0.0.a11
pip install pytest

Build and install aimrocks

python setup.py build
python setup.py install

Run tests

pytest tests